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1  Introduction 


Today,  numerical  optimization  is  the  approach  of  choice  for  all  but  the  simplest  digital  filter  de¬ 
signs.  Most  software  used  for  optimization-based  filter  design  can  be  roughly  separated  into  two 
categories.  The  first  is  the  general-purpose  solver  (the  f  mincon  and  fminunc  functions  of  the  ubiq¬ 
uitous  Matlab  Optimization  Toolbox  are  prime  examples),  which  assumes  little  about  the  problem 
structure  and  permits  almost  any  objective  or  constraints.  This  flexibility,  however,  is  offset  by 
a  great  deal  of  inefficiency  and  is  unsuitable  for  large  problems.  The  second  group  is  the  custom 
solvers,  written  to  solve  a  specific  problem  or  related  set  of  problems.  The  classic  Remez-exchange- 
based  Parks-McClellan  Q]  algorithm  (function  remez  in  Matlab)  is  still  the  premier  representative 
of  this  class,  used  to  design  optimal  L„  (minimax)  filters.  Another  popular  technique  is  the  method 
of  least-squares,  providing  filters  optimal  in  the  L2  sense.  The  efficiency  of  these  methods  is  tem¬ 
pered  by  their  inflexibility,  as  they  severely  restrict  the  available  problem  types. 

Increasingly,  custom  methods  are  being  developed  that  provide  more  flexibility,  offering  more 
than  just  L2  and  L  designs.  In  [2],  iterative  reweighted  least  squares  (IRLS)  was  used  to  allow 
general  Lp  norm  design,  with  different  values  of  p  applied  to  the  filter  passband  and  stopband.  Slow 
convergence  in  some  cases  was  later  improved  [3j.  Another  approach  is  to  combine  Loo  and  L2 
optimization  methods.  Peak  Constrained  Least  Squares  (PCLS)  |4j  is  one  such  approach,  where  a 
least-squares  design  is  performed  subject  to  an  Loo  constraint.  An  equivalent  unconstrained  method 
is  to  minimize  a  combined  norm,  formed  as  the  convex  combination  of  the  Loo  and  L2  norms  (5J . 

Straddling  the  line  between  general  solver  and  custom  algorithm  are  tools  designed  to  interface 
to  solvers  of  highly  structured  canonical  problems.  Important  examples  of  structured  problems  in¬ 
clude  linear  programs  (LP),  second-order  cone  programs  (SOCP)  (6j],  and  semidefinite  programs 
(SDP)  [7].  LPs,  SOCPs,  and  SDPs  are  all  convex  optimization  problems  that  can  be  solved  by  a 
relatively  new  class  of  robust  and  highly  efficient  interior-point  algorithms  |8j[9  10  11 1.  Convex¬ 
ity  is  important,  as  it  guarantees  a  global  solution  when  a  solution  exists.  Linear-  programming  is 
limited  to  an  objective  and  constraints  that  are  all  affine  in  the  optimization  variables.  Even  so,  a 
great  number  of  filter  design  problems  can  be  solved  using  LP.  Early  tools  designed  to  automati¬ 
cally  generate  linear  programs  from  filter  specifications  include  the  FF  design  language  G3  and 
the  METEOR  program  1 13 1.  The  qdes  program  1 14 1  similarly  produces  quadratic  programs  (con¬ 
vex  quadratic  objective,  affine  constraints)  from  linear-controller  specifications.  SOCP  augments 
LP  with  second-order  cone  constraints,  which  include  convex  quadratic  constraints.  The  authors’ 
own  Opt  Matlab  toolbox  fl5|  provides  filter-related  data  structures  and  a  flexible  interface  to  sev¬ 
eral  second-order  cone  programming  (SOCP)  engines.  SDP  further  adds  linear  matrix  inequalities, 
which  restrict  variables  or  their  affine  combinations  to  the  cone  of  positive-semidefinite  matrices. 
LMITOOL  [  16j,  though  not  filter-specific,  provides  a  friendly  interface  to  various  semidefinite- 
programming  (SDP)  engines.  The  restriction  to  a  suitable  one  of  these  problem  types  leads  more 
efficiently  to  the  solution  while  preserving  a  surprising  amount  of  flexibility  through  the  creative 
combination  of  multiple  constraints.  A  big  advantage  of  this  separation  of  high-level  design  and 
low-level  numerical  solution  is  that  new  constraints  and  new  constraint  types  can  be  added  to  an 
existing  design  without  the  need  to  extend  or  retune  (or  deeply  understand)  the  algorithm. 

In  this  paper  we  show  that  SOCP  can  be  used  to  optimize  filters  using  an  arbitrary  number 
of  Loo,  L2,  and  L\  constraints  (including  PCLS),  as  well  as  constraints  on  linear  combinations  of 
the  Loo,  L2,  and  L\  norms.  A  alternate  method  of  combining  norms  through  linear  combinations 
of  their  unit  balls  is  also  presented,  and  it  is  shown  that  a  vector  norm  introduced  by  Burdakov 
and  Merkulov  [17|,  when  extended  to  complex  functions,  is  a  special  case  that  combines  Loo  and 
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L,2-  This  norm  is  of  interest  because  it  has  similar  characteristics  to  the  Lp  norm,  which  cannot  be 
optimized  using  SOCP  unless  p€{  1 , 2,  °o}.  It  is  shown  that  there  is  a  convenient  duality  relationship 
between  combining  norms  directly  and  indirectly  through  their  unit  balls,  with  the  result  that  two 
complete  families  of  norms  spjimjing  from  L\  to  Li  to  can  be  optimized  using  SOCP.  Examples 
are  provided  to  demonstrate  the  different  properties  of  these  combined  norms.  A  condensed  version 
of  this  work  was  presented  in  [18]. 


2  Problem  Specification 

The  classic  approach  to  filter  design  in  the  frequency  domain  is  to  minimize  some  norm  ||£j|  of  a 
weighted  frequency  response  error  E(f)  =W(f)[G(f)H(f)—D(f)],  where  W  is  areal,  nonnegative 
weighting  function,  G  is  the  equivalent  frequency  response  of  other  (fixed)  filters  in  cascade,  H  is 
the  frequency  response  of  the  filter  being  designed,  and  D  is  the  desired  frequency  response.  Both 
E  and  G  are  in  general  complex-valued  periodic  functions  of  real  optimization  variables  x.  For 
flexibility  here  a  more  general  filter-design  formulation  is  chosen: 

min .  f7  x 

s.t.  \\Ek\\  <  4,  k=l,...,K. 

Both  the  error  functions  and  the  norms  can  be  different  for  each  constraint.  The  bounds  8/(  can  be 
constants  or  affine  functions  of  the  optimization  variables.  Other  SOCP  constraints  can  be  added  as 
needed,  but  will  not  be  considered  here. 

This  paper  will  restrict  its  attention  to  FIR  filters,  so  that  the  optimization  variables  x  represent 
the  real  and  imaginary  parts  of  the  filter  coefficients  and  any  required  auxiliary  variables: 

G(f)=^2n  +  jX2n+l)e~^fn. 

n 

This  can  also  be  written 

G(f)  =  />, 

where  *¥(/)  is  the  vector  of  exponentials  corresponding  to  frequency  /.  No  assumptions  are  made 
regarding  coefficient  symmetry.  The  restriction  to  FIR  filters  ensures  that  G  and  thus  E  are  affine 
functions  of  the  optimization  variables,  and  that  ||£j|  is  a  convex  function  of  the  optimization  vari¬ 
ables.  HR  filter  problems  are  nonconvex  with  multiple  local  minima  and  cannot,  in  general,  be 
directly  ofTnhized  using  SOCP  or  other  convex  methods.  Iterative  methods  such  as  Steiglitz- 
McBjndje  [19]  can  be  used  to  apply  the  methods  presented  here  to  HR  filters,  as  is  done  in  [5] 
and  [20],  among  others.  These  methods  solve  a  particular  joint  design  of  the  FIR  numerator  and  de¬ 
nominator  filters  at  each  stefTWhile  they  can  produce  reasonable  filters,  they  do  not  truly  optimize 
the  HR  frequency  response  [21]. 

Since  FIR  (and  stable  HR)  frequency  responses  have  bounded  magnitudes  and  are  periodic  with 
period  one  they  are  effectively  in  L„[0, 1],  the  space  of  bounded  complex- valued  functions  on  the 
interval  [0, 1],  This  implies  that  they  also  belong  to  the  space  Lp[ 0, 1]  for  any  p  >  1,  and  in  particular 
to  the  space  Z,2[0, 1]  of  finite-energy  complex- valued  functions  on  [0, 1],  This  largely  removes  the 
need  to  consider  pathological  functions  in  the  following  analysis. 


3  Second-Order  Cone  Programming 

A  powerful  special  case  of  convex  optimization  is  second-order  cone  programming,  or  SOCP  [6J. 
SOCP  allows  the  minimization  of  a  linear  objective,  subject  to  second-order  cone  (SOC)  constraints, 
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which  encompass  linear  and  convex  quadratic  constraints.  One  standard  formulation  of  a  SOCP  is 
min .  f7x 

X 

s.t.  ||Aj[x  +  b*||2  <  c{x  +  dk,  k  =  l,...,K. 

The  number  of  linearly  independent  columns  in  A*  is  Rk,  the  rank  of  the  second-order  cone.  An 
equivalent  notation  for  a  SOC  constraint  is  the  pair  of  constraints 

|| Ax  +  b|||  <  (c 1  x  +  d)2 
0  <  c  Tx  +  d. 


Although  this  form  tends  to  be  the  most  convenient  for  filter  design  due  to  the  explicit  inequality 
constraints  for  some  applications  the  dual  problem  116]] 

max.  '£k{-dkbl)yk 

s.t.  (— Cfc,  Ak)yk  =  fk 

||([y>t]2,  -  -  ■ ,  [y>t]/?A.)7’||2  <  [y*]i  k  =  i,...,K 


is  preferred.  The  primal  and  dual  problems  are  equivalent  in  that  any  problem  that  can  be  expressed 
in  one  form  can  be  converted  to  the  other  via  auxiliary  variables.  Most  modern  solvers  iteratively 
solve  both  problems  simultaneously,  so  the  choice  of  problem  formulation  is  generally  based  on 
convenience. 

Although  SOCP  seems  quite  limited,  with  only  one  basic  type  of  constraint,  it  can  be  used  to 
solve  a  wide  range  of  problems  using  creative  combinations  of  multiple  constraints.  A  linear  con¬ 
straint  results  as  a  special  case  when  Ak  and  b/  are  zero.  Of  specific  interest  here,  SOCP  can  be  used 
to  exactly  constrain  /] ,  fa,  and  LXJ  norms  of  error  vectors  that  are  affine  in  the  optimization  variables. 
Using  discretization  SOCP  can  be  used  to  approximately  constrain  L\,  L2,  and  Lx  norms  of  affine 
error  functions  [6]  22 1 .  Exact  L2  formulations  also  exist  [23 1  that  do  not  require  discretization.  Any 
constraint  can  also  be  used  as  the  objective  via  an  auxiliary  variable: 


min .  8 

x,8 

s.t.  ||Ajx  +  bjfc||2  <  5. 

The  following  sections  briefly  summarize  how  SOCP  can  be  used  to  constrain  the  various  norms  of 
an  error  function  E  :  [0, 1]  x  — >  C  that  is  affine  in  the  optimization  variables,  the  dependence  on 
which  is  hereafter  implicit. 


3.1  Lex, -Norm  Constraints 

For  a  function  E  the  U  or  Chebychev  norm  is  defined  as 

||£j|oo  =  ess  sup  \E(f)\. 
f 

Since  the  functions  of  interest  (FIR  transfer  functions)  are  continuous  and  periodic,  this  reduces  to 

||£j|co  =  max  \E(f)  |. 


For  a  function  E  that  is  affine  in  the  optimization  variables,  the  Loo -norm  can  be  (approximately) 
constrained  using  SOCP  by  discretizing  the  interval  [0,1].  Letting  {0,/i, . . .  ,/k-i,  1}  partition  the 
interval  [0, 1]  (choosing  fk  =  k/K  is  common),  the  set  of  rank-2  SOC  constraints 


R e{E(fk)} 
Im  {£(/*)} 


<  8,  k  =  0,...,K 
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bounds  the  maximum  value  of  \E(fi<)  |  on  the  grid  by  8 ,  which  can  be  a  constant  or  an  auxiliary 
optimization  variable.  This  will  be  written  more  compactly  in  the  sequel  as 

\E(fk)\<8,  k  =  0,...,K. 

The  spacing  between  the  grid  points  must  be  chosen  to  limit  violations  of  the  bound  between  con¬ 
straints  to  acceptable  levels.  Errors  between  the  discretized  approximation  and  the  true  norm  can 
be  made  arbitrarily  small  at  the  cost  of  an  increased  number  of  constraints.  Often  a  looser  grid  is 
used  in  the  initial  stages  of  a  design  to  obtain  rapid  solutions,  while  a  tight  grid  is  used  for  the  final 
design.  For  an  FIR  filter  of  length  N  an  approximate  rule  of  thumb  for  the  minimum  grid  spacing  is 
1/(2  ON). 

If  £  is  a  real- valued  function,  representing  a  linear-phase  filter,  then  using  SOC  constraints  as 
shown  above  results  in  a  degenerate  rank-1  cone.  Using  cones  here  is  inefficient;  instead  use  a  pair 
of  linear  constraints  per  frequency: 

S<E{fk)<8,  lc  =  0,...,K. 


3.2  L?-Norm  Constraints 

In  contrast  to  the  L„  norm,  which  requires  one  constraint  per  discrete  frequency,  the  L2  norm  re¬ 
quires  only  a  single  SOC  constraint.  The  L2  norm  is  defined  as 

\\Eh=  (£\E(f)\2df)  2 . 

Since  E  was  assumed  affine  in  the  optimization  variables  x,  the  result  can  be  written  as  a  positive 
semidehnite  quadratic  form  in  x: 

\\E\\l  =  xrQx. 

The  real,  positive-semidehnite  kernel  Q  can  be  factored  as  Q  =  S7  S,  reducing  the  right  side  to  the 
desired  form: 


\E\\22  =(Sx)r(Sx) 
=  1 1  Sx  1 1 2 . 


Thus  an  L2  constraint  can  always  be  represented  exactly  with  a  SOC,  provided  the  integral  can 
be  calculated  exactly.  In  many  cases  this  can  be  achieved  using  the  random  process  formulation 
of  [23 1 .  If  not,  the  integral  must  be  evaluated  using  a  numerical  method,  perhaps  the  simplest  being 
a  Riemann  sum  over  a  uniform  partition  {//}  of  [0, 1].  The  resulting  SOC  constraint  can  be  written 


£|£(/,)|2A/<S2, 


where  8  is  a  nonnegative  constant  or  auxiliary  variable.  Compared  to  the  L„  norm  it  takes  a  tighter 
grid  to  get  the  same  level  of  approximation  error  using  a  Riemann  sum,  a  rough  rule  of  thumb  being 
A /  «  1/ (4  (TV).  The  choice  of  a  small  spacing  has  less  impact  since  it  does  not  increase  the  size  of 
the  optimization  problem  itself. 
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3.3  Li-Norm  Constraints 


The  L\  norm  is  the  trickiest  of  the  norms  to  constrain  using  SOCP  as  well  as  the  least  common.  One 
application  is  in  the  design  of  communication  filters  to  control  intersymbol  interference  [24].  The 
L\  norm  is  defined  as 

m\i  =  C\E{/)\df. 


JO 

Approximating  the  integral  directly  as  a  Riemann  sum  does  not  result  in  a  SOC.  Instead,  introduce 
the  real,  nonnegative  auxiliary  function  /3  :  [0, 1]  — >  R+  and  consider  the  pair  of  constraints 


\E(f)\<P(f) 

['ll  (f)df<8. 

Jo 

Due  to  the  nonnegativity  of  /3 ,  this  is  equivalent  to 

[l\E(f)\df<8. 

Jo 


To  discretize,  choose  a  uniform  partition  {/j.}  of  [0, 1]  and  introduce  the  auxiliary  optimization 
variables  { /3/t } -  The  following  set  of  constraints  then  approximates  the  integral: 


\E(fk)\<pk,  k  =  0,...,K 

I  fcA/<5. 

k 

As  with  the  L„  norm,  linear  constraints  rather  than  SOC  constraints  should  be  used  when  E  is  real¬ 
valued.  Although  this  method  introduces  many  new  variables  as  well  as  constraints,  the  resulting 
problem  is  quite  sparse  and  can  be  efficiently  handled  by  most  available  solvers.  The  L[  norm 
is  even  more  sensitive  than  the  Li  norm  to  small  values  in  its  argument,  and  as  such  an  accurate 
approximation  requires  an  even  tighter  grid  of  frequencies.  A  rule  of  thumb  is  Af  ~  1  / (6 ON). 


4  Combining  Norms 

Although  pure  and  Li  solutions  have  been  used  in  digital-filter  design  for  some  time  and  remain 
the  most  popular  in  practice[]]in  real  world  designs  it  is  common  to  want  to  trade  off  the  properties 
of  the  different  designs.  One  way  to  do  this  is  to  optimize  the  filter  with  respect  to  a  norm  that  lies 
in-between  Li  and  L  in  some  sense.  The  Lp  norm,  for  example,  is  defined  as 

m\P=  (j\E{f)\Pdfy ,  P> i, 

and  thus  provides  a  continuum  of  norms  from  L\  through  Loo.  Although  SOCP  can  handle  only 
P  =  {l,2,°o},  there  are  two  related  methods  that  can  be  used  to  combine  two  norms  to  form  a 
new  norm.  In  each  case  a  single  scalar  parameter  controls  the  relative  contribution  from  each  of 
the  component  norms.  The  first,  the  convex  combination  of  norms  denoted  here  as  the  a-norm, 
already  enjoys  widespread  use  under  various  guises.  The  second,  the  convex  combination  of  unit 
balls,  is  an  extended  version  of  the  recently  introduced  e-norm  [17].  The  former  enjoys  better 
theoretical  justification  in  terms  of  typical  system  requirements,  while  the  latter  appears  to  more 
closely  approximate  the  Lp  norm.  Both  will  be  described  in  turn,  followed  by  the  derivation  of  their 
dual  norms. 

'The  window  method  doesn’t  count  as  a  filter  design  technique. 
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4.1  Convex  Norm  Combinations — The  a-Norm 


The  most  straightforward  way  to  combine  the  L2  and  L„  norms  is  through  a  simple  convex  combi¬ 
nation.  Letting  a  S  [0, 1],  the  a-norm  is  defined  here  as 

Ill'll «  =  a||£,||2  +  (l  —  a)||£,||oc  (1) 

This  is  essentially  equivalent  to  the  norm  introduced  in  |J5].  It  is  straightforward  to  verify  the  prop¬ 
erties  of  a  norm  for  the  a-norm,  as  they  all  follow  immediately  from  the  properties  of  the  Li  and 
norms.  As  noted  in  j5j,  the  unconstrained  minimization 


and  the  constrained  minimization 


min.  Ulilla 

X 

min.  ||U||2 

X 

s.t.  ||U||oo</3 


(2) 

(3) 


have  the  same  solution  space  and  are  thus  functionally  equivalent.  The  latter  problem  has  been 
dubbed  peak-constrained  least  squares  (PCLS)  in  the  literature  [4j  or  simply  constrained  L2  design 
©•  An  advantage  of  the  unconstrained  approach  is  that  a  solution  is  always  obtained,  as  without 
constraints  there  can  be  no  infeasible  region.  The  constrained  approach,  on  the  other  hand,  allows 
the  peak  error  to  be  explicitly  fixed  to  meet  given  specifications.  In  any  practical  design  there  will  be 
many  iterations,  and  so  the  choice  is  really  between  iterating  a  and  iterating  the  peak -error  bound 
/j.  Either  can  be  formulated  as  an  SOCP:  the  a-norm  can  be  minimized  by  the  program 


min.  a<S  +  (l  —  a)/3 

x,5,  p 

s.t.  \E(fk)\  <  P,  k  =  0,...,K  (4) 

£|U(/,)|2A/<52,  <5  >  0, 

k 

where  8  and  /3  are  nonnegative  auxiliary  variables,  while  the  PCLS  problem  can  be  solved  as 


min .  8 

x,8 

s.t.  \E{fk)\  </3,  k  =  0,...,K 
£|U(/,)|2A/<52,  <5  >  0, 

k 

with  /3  a  constant  and  8  an  auxiliary  variable. 

The  usual  justification  for  using  PCLS  stems  from  the  observation  that  a  small  increase  in  the 
peak  error  of  a  Loo-optimal  filter  frequency  response  usually  allows  a  large  reduction  in  the  Li  norm. 
Generally  the  peak  sidelobes  of  an  /^-optimal  frequency  response  only  exceed  those  of  the  La 0- 
optimal  response  in  a  narrow  spectral  region  near  the  transitions  between  passband  and  stopband. 
PCLS  allows  these  sidelobes  to  be  controlled  in  an  otherwise  L2 -optimal  design.  In  terms  of  general 
system  parameters  the  L „  bound  controls  the  worst-case  performance  in  the  presence  of  unknown 
spectral  components,  while  the  Li  norm  determines  the  average  performance;  a  natural  tradeoff. 
In  the  examples,  it  will  be  seen  that  filters  optimized  according  to  the  combined  a-norm  retain 
properties  of  both  and  /^-optimized  filters. 

Some  properties  of  the  a-norm  can  be  derived  from  the  definition  and  the  properties  of  the  Lp 
norms.  Clearly  Li  and  L«,  result  as  special  cases  of  the  a-norm  with  a  =  1,0  respectively.  The 
norm  is  monotonically  nonincreasing  in  a,  that  is  |£j|ai  <  | U 1 1 a,  for  ai  >  a2,  and  is  bounded 
by  its  component  norms:  ||£j|2  <  ||£j|a  <  ||£j|oo.  Both  follow  from  the  general  LP[0,1]  relation 
\\E\\p  <  \\E\\q  for  p  <q. 
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4.2  Convex  Unit-Ball  Combinations — The  e-Norm 


In  the  previous  section  we  showed  that  the  a-norm  is  actually  a  family  of  new  norms  that  can  be 
obtained  through  a  direct  convex  combination  of  the  L2  and  norms.  Another  way  to  combine  the 
two  norms  is  via  their  unit  balls,  defined  by  B(||  ■  ||)  =  {E  :  ||£||  <  1}.  A  standard  analysis  result  [25] 
holds  that  a  norm  is  uniquely  identified  by  its  unit  ball,  and  that  further  any  set  that  meets  certain 
conditions  is  the  unit  ball  of  a  norm,  implicitly  defining  the  norm.  There  are  various  ways  to  state 
the  conditions,  one  of  which  is  given  in  the  following  lemma: 

Lemma  1.  Let  the  closed  bounded  convex  set  B  in  a  complex  vector  space  X  also  satisfy 

1.  x  £  B  = =>■  e^x  £  B,  V(f)  £  [0,2tt]  (symmetry) 

2.  V*  £  X  3 A  £  M  :  A  /  0,  Xx  £  B.  ( absorbing ) 

Then  B  is  the  unit  ball  of  the  norm  defined  by 

||;c||  =  inf{A  >  0  :  *  £  LB}. 

Now,  in  the  space  Z.2  [0, 1]  for  0  <  £  <  1  consider  the  set 

Be  =  £fi(IH|2)©(i-£)£(IHU) 

—  {fit/  +  (1  —  £)V  :  ||I/||2  <  1 ,  || V  ||oo  <  1} 


(5) 


a  convex  Minkowski  sum  of  the  unit  balls  of  the  L2  and  norms.  It  is  straightforward  to  show  that, 
since  both  unit  balls  necessarily  meet  the  conditions  of  Lemma[T]  so  does  their  convex  combination. 
Thus  we  have  implicitly  defined  a  new  norm  with  unit  ball  Be,  known  as  the  £-norm  and  denoted 
||  •  ||e.  Clearly  for  £  =  1  and  £  =  0  this  reduces  to  the  L2  and  L„  norms,  and  so  the  £-norm  represents 
a  new  family  spanning  the  continuum  between  the  two. 

The  £-norm  was  first  described  in  [17]  as  a  family  of  vector  norms  on  M".  The  definition 
and  two  associated  lemmas  from  that  paper,  extended  here  to  L2[0, 1],  provide  greater  geometrical 
insight  into  the  properties  of  the  £-norm  by  directly  incorporating  the  properties  of  the  L„  norm. 
The  proofs  are  deferred  to  the  appendix. 

Definition:  For  a  function  E  £  L2[0, 1]  and  0  <  £  <  1,  define  the  £-norm  of  E,  denoted  ||Z? ||e,  as 
the  unique  solution  V*(E)  of 


h(y,E)  =  ||  [|£'|  —  (1  —  £)v]  +  ||2  —  £V  =  0. 

+  is  defined  pointwise  by  [£'(/)]+  =  max{0, E(f)}. 


The  positive  operator 
Lemma  2.  For  any  function  E  the  pair  of  functions 


(6) 


Ee  =ejZE[\E\-{l-e)\\E\\e] 


El~e  =  E  —  Ee 


define  the  unique  decomposition  E  =  Ee  +  E  £  called  the  £-decomposition  such  that 

\\Ee\\2  =  £\\E\\, 


fi-ei 


=  (1  —  £)l|£| 


(V) 

(8) 


(9) 

(10) 


Lemma  3.  The  unit  ball  of  the  solution  to  ([6])  is  Be. 
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\E(f)\ 


Figure  1 :  Graphical  representation  of  the  e-decomposition. 


This  last  lemma  is  included  simply  to  verify  that  the  e-norm  of  [17]  is  indeed  the  same  as 
the  norm  implicitly  defined  in  <|5]).  Lemma  12]  offers  a  convenient  geometric  interpretation  of  the 
definition  of  the  e-norm  as  illustrated  in  Fig.  [Tj  the  plot  of  a  representative  function  \E\.  The  dashed 
line  represents  the  value  of  (1  —  e)v  in  ([6]).  The  portion  of  \E\  below  the  dashed  line  is  a  flat-topped 
function  with  norm  (1  —  e)v,  while  the  portion  above  the  line  is  the  function  inside  the  Lj  norm 
in  <©•  When  v  =  ||2?||e  the  value  of  the  L2  norm  is  e||£||e,  the  function  above  the  line  is  |£'e|, 
and  the  function  below  the  line  is  |£1_e|.  Both  Ee  and  E[  ~E  have  the  same  phase  as  E  and  add 
constructively.  The  relative  “size”  of  Ee  and  El  ~e  varies  with  £;  for  £  =  1,  El  e  vanishes,  as  £  is 
decreased,  El~e  grows  at  the  expense  of  E£. 

For  filter  design  puiposes,  we  need  a  way  to  constrain  the  £-norm  of  affine  error  functions.  The 
following  set  of  constraints  use  the  construction  of  the  norm  to  together  effectively  bound  ||£||e  by 
v: 


\\U\\2  <  £V 

II E -U ||oo  <  (1  — £)v, 

where  U  represents  an  auxiliary  function  implemented  as  a  set  of  complex  optimization  variables 
on  the  discretized  set  of  frequencies.  The  £-norm  of  the  error  can  be  approximately  minimized  via 
the  SOCP 


min.  v 
x,v,U 

s.t.  £|t4|2A/<  (£v)2  (11) 

k 

\E(fk)~Uk\  <  (1  -£)v,  k  =  0,...,K. 

4.3  The  Dual  Norms  of  the  a-  and  £-Norms 

The  a-norm  and  £-norm  both  span  a  continuum  from  L2  to  L«,.  To  extend  both  through  L\,  recall 
that  the  dual  norm  of  Lp,  2  <  p  <  °o  is  Lq,  where  1  <  q  =  p/(p  —  1)  <2,  and  that  L\  and  are  dual 
norms.  This  suggests  that  the  duals  of  the  £-  and  a -norms  will  similarly  span  a  continuum  from  L2 
to  L\.  This  is  verified  by  the  following  lemma. 

Lemma  4.  The  dual  norm  of  the  E-norm  is  given  by 


i- 


(12) 


2 


Figure  2:  A  graphical  comparison  of  the  unit  balls  of  the  Lp,  £-, 
and  a -norms  in  the  first  quadrant  of  M2. 


The  formal  definition  of  the  dual  norm  and  the  proof  of  this  lemma  are  found  in  the  appendix. 
The  lemma  reveals  that  the  £-norm  dual  is  a  convex  combination  of  the  L2  and  L\  norms.  This 
suggests  a  rather  satisfying  symmetry  that  is  completed  with  the  dual  of  the  a-norm,  ||  •  ||^,  whose 
unit  ball  is  a  convex  combination  of  the  unit  balls  of  the  L2  and  L\  norms: 

S(IMI«)  =  «S(|M|2)©(l-a)JB(||-||1). 

This  norm  cannot  be  defined  in  the  form  of  ([6]),  which  depends  on  the  properties  of  the  L,XJ  norm, 
but  we  can  constrain  it  similarly  with  the  pair  of  constraints 

1 1 T/ 1 1 2  <  av 
\\E-U\h  <  (l-a)v. 

The  preceding  shows  that  the  two  methods  for  combining  norms  are  intimately  connected:  an  £- 
norm-style  convex  combination  of  unit  balls  of  two  norms  has  as  its  dual  norm  an  a-norm-style 
convex  combination  of  the  duals  of  the  two  norms.  Together  the  £-norm  and  its  dual  form  a  contin¬ 
uum  of  norms  connecting  L[  to  Li  to  L„,  as  does  the  a-norm  and  its  dual. 

Although  it  is  difficult  to  visualize  the  unit  ball  of  an  infinite-dimensional  norm,  it  is  instructive 
to  consider  the  unit  balls  of  the  various  norms  in  M2,  representing  a  (very)  coarsely  discretized 
problem.  In  Fig.  [2}  the  unit  balls  for  the  £-norm  and  dual  and  the  a-norm  and  dual  are  compared  in 
turn  to  the  unit  ball  of  a  coarse  approximation  of  Lp, 

(ihr+iter)'"- 

Flere  p  =  3.5,  q  =  1 .4.  £  =  0.5,  and  a  =  0.7,  chosen  empirically  to  best  match  corresponding  norms 
visibly.  In  both  plots  the  diagonal  line,  quarter  circle,  and  square,  representing  the  first  quadrant  of 
the  unit  balls  of  L\,  L2,  and  L„,  respectively,  are  shown  for  reference.  Inspection  reveals  the  £-norm 
to  be  a  closer  visual  match  to  Lp  than  is  the  a-norm.  This  observation  will  be  reinforced  in  the 
examples. 

4.4  Two  More  Combined  Norms 

So  far  the  two  combined  norm/dual  norm  pairs  {||  •  ||^),||  -  ||e}  and  { ||  ■  || « 5 1|  •  || «}  have  been  formed 
by  combining  the  L\,  L2,  and  L„  norms.  We  can  form  two  more  families  of  norms  by  forming  the 
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convex  combination  of  the  unit  balls  of  L\  and  L and  by  convex  combination  of  the  two  norms 
themselves.  These  two  new  families  form  a  dual  pair,  and  both  span  the  whole  range  from  L\  to 
Loo.  These  norms  do  not  resemble  Lp  in  general  nor  do  they  include  L2  as  a  special  case.  However, 
they  do  have  the  advantage  that  they  can  be  implemented  using  only  linear  programming  when  E  is 
real-valued. 

Although  limited  to  pairwise  combinations  of  norms  easily  constrained  using  SOCP,  the  analysis 
in  this  paper  can  be  trivially  extended  to  the  convex  combination  of  an  arbitrary  (but  finite)  number 
of  norms  or  unit  balls,  as  well  as  to  norms  other  than  Lp. 

5  Examples 

In  this  section  we  present  two  examples.  The  first,  a  standard  lowpass  filter  with  reduced  group 
delay,  is  repeatedly  optimized  to  illustrate  the  characteristic  error  responses  corresponding  to  the 
various  norms.  The  second,  a  multiband  filter,  demonstrates  the  flexibility  of  the  SOCP  approach  to 
subject  different  regions  of  the  frequency  response  of  a  filter  to  different  norm  constraints. 

5.1  Example  1:  A  Lowpass  Filter 

A  simple  lowpass  filter  was  optimized  using  the  various  combined-norm  SOCP  techniques  pre¬ 
sented  in  the  previous  section  and  compared  to  L\,Li,  and  L„  optimizations  as  well  as  the  general  Lp 
solution.  The  filter  has  35  real  coefficients  with  no  symmetry  and  a  reduced  passband  delay  (relative 
to  a  linear  phase  filter)  of  10  samples,  resulting  in  a  complex  frequency  response.  The  passband  and 
stopband  cover  the  intervals  [0,0.1]  and  [0.15,0.5],  with  the  remainder  of  the  frequency-response 
period  defined  by  symmetry.  An  error  weighting  function  W  of  one  in  the  passband,  four  in  the 
stopband,  and  zero  in  the  transitions  was  applied. 

For  reference,  the  filter  was  designed  by  minimizing  the  L\,  L2,  and  norms  of  the  error  using 
SOCP  as  described  in  Section[3]  The  magnitude  and  weighted  error  responses  of  the  resulting  filters 
are  shown  in  Fig.  [3]  Here  we  clearly  see  the  classic  characteristic  responses  of  the  three  norms.  The 
Loo  design  is  equiripple  across  the  entire  band.  The  L2  design  error  peaks  fall  monotonically  away 
from  the  transition  band,  and  only  exceed  the  L„  error  close  to  the  transition  band.  This  is  a  primary 
reason  many  argue  against  pure  designs.  The  L\ -optimized  error  falls  off  even  faster,  at  a  cost  of 
larger  errors  at  the  band  edges.  Qualitatively,  L\  designs  put  emphasis  on  lowering  the  lowest  errors, 
Loo  designs  put  emphasis  on  lowering  the  highest  errors,  and  L2  designs  occupy  a  middle  ground. 

Now  consider  intermediate  designs  between  the  L2  and  Loo  designs.  Three  methods  have  been 
presented:  a  true  Lp  design  using  a  general-purpose  or  custom  solver,  and  minimizing  the  a  and  e 
combined  norms  using  the  SOCPs  in  Q  and  (fTT|).  Each  was  performed  for  three  intermediate  values 
and  are  shown  in  Fig.  [4]  The  values  of  a  and  e  are  given  in  the  plots  for  reference  only;  there  is  no 
known  convenient  mapping  between  these  parameters  and  the  closest  approximating  value  of  p.  The 
values  were  chosen  empirically  to  achieve  a  good  visual  match  between  the  various  design  methods 
for  comparison  puiposes.  As  one  might  expect,  the  Lp  designs  provide  a  smooth  transition  from  L2 
to  Loo,  with  the  slope  of  the  error  rolloff  gradually  decreasing  as  the  overall  error  level  increases.  The 
peak  error  is  still  at  the  transition,  but  the  gap  between  the  highest  and  lowest  error  peaks  shrinks 
as  p  increases.  Comparing  the  Lp  plots  to  the  corresponding  a-norm  designs,  we  see  that  the  error 
peaks  of  the  latter  no  longer  fall  off  monotonically.  Instead  we  have  an  equiripple  region  starting  at 
the  transition  that  grows  with  decreasing  a.  The  equivalent  constrained  formulation  of  (|3])  suggests 
why:  since  the  largest  error  ripples  typically  occur  near  the  transition,  the  peak-error  constraint  is 
active  in  this  region.  Away  from  the  transition,  the  peak  constraint  is  inactive,  and  the  response 
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frequency  frequency  frequency 


Figure  3:  L\ ,  Li,  and  L^-optimizcd  FIR  filter  responses. 


resembles  a  pure  Li_  response.  Thus  the  effect  of  combining  the  Z/>  and  Loo  norms  in  this  way  is 
to  partition  the  frequency  axis  into  Li  and  La »  regions.  The  £-norm,  on  the  other  hand,  like  the  Lp 
norm,  smoothly  transitions  from  equiripple  errors  to  L2-type  errors  everywhere  on  the  frequency 
axis  as  £  is  increased  from  0  to  1,  and  generally  has  no  equiripple  errors  for  e  >  0  (although  the 
lowest  eiTor  peaks  are  very  nearly  equal  in  height).  Visually,  at  least,  the  £-norm  designs  provide  a 
good  approximation  of  true  Lp  designs. 

To  compare  norms  between  L\  and  L2,  the  same  design  was  also  optimized  using  the  duals  of 
the  norms  from  the  previous  example.  A  representative  design  using  each  of  the  three  dual  norms 
is  shown  in  Fig.  [5]  Although  the  comparison  is  less  obvious  here,  the  £-norm  dual  provides  a  closer 
approximation  to  the  Lp  norm  for  1  <  P  <  2-  Again  the  O' -norm  shows  a  band-partitioning  effect: 
near  the  transition  the  peak  error  is  higher  and  falls  off  faster  like  an  L\  design,  while  near  the 
Nyquist  frequency  the  slope  is  much  flatter  like  an  Li  design. 
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(a)  Lp-optimized  FIR  filter  responses,  2  <  p  < 
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(b)  a-norm  optimized  filters, 
e  =  0.45_ e  =  0.21 
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(c)  e-norm  optimized  filters. 

Figure  4:  Mixed  Ln/Lco-optimized  filters. 
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L  1.25  e-dual,  e  =  0.21  a-dual,  a  =  0.45 


frequency  frequency  frequency 


Figure  5:  Mixed  Li/L2-optimized  filter  responses. 

5.2  Example  2:  A  Multiband  Filter 

To  demonstrate  the  flexibility  of  SOCP-based  design,  a  75-complex-tap  nonlinear-phase  FIR  filter 
was  designed  with  four  passbands  and  four  stopbands.  Each  passband  was  designed  to  approximate 
a  different  delay,  while  the  error  in  each  stopband  was  constrained  using  a  different  mixed  norm: 

min.  ||£pb||2 

X 

s.t.  ||£sbl||a<10-40/20 

||£sb2||e<10-4°/20 

||£sb3||g<10-50/2° 

||£Sb4||?  <  10  5°/20. 

The  passbands  occupy  the  intervals  [0,0.05],  [0.25,0.3],  [0.5,0.55],  and  [0.75,0.8]  with  a  single 
passband  weighting  function  of  unity  on  the  intervals  and  zero  elsewhere.  The  desired  response  on 
the  passbands  is  unity  gain  with  delays  of  37,  36,  35,  and  34.  The  stopbands  occupy  the  intervals 
[0.07,0.23],  [0.32,0.48],  [0.57,0.73],  and  [0.82,0.98],  each  with  a  weighting  function  of  unity  on 
the  corresponding  interval  and  zero  elsewhere.  This  was  solved  using  the  following  SOCP  program 
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Figure  6:  Multiband  filter  response. 


(the  horizontal  lines  delineate  the  different  norm  constraints): 


min .  8 

x,8,8uyi,  {/hjth  {/34  ,*},  {f/4,*} 


L,|£pb(/,)|2A/<52, 

8  >0 

Lt  £sbl  (fk)  |2A/  <  Sf , 

5i  >0 

|£sbt(/,0l<7i, 

a<Si  +  (1  -  a)7i  <  10  4°/20 

k  =  0,.. 

Lk \U2,k\2Af  <  e2lO_40/10 

I^sb2(/fc)  -  UiA  <  (1  -  e)^-40/20 

,k  =  0,.. 

.,K 

Ir|f/3,t.|2A/<«BlO-50/1° 

I^sb3 (fk)  ~  U3 tk\  <  fo,k, 
I*feA/<(l-aD)l(r50/20 

k  =  0,.. 

.,K 

Lk\ESM(fk)\2Af  <  Si 

54>0 

I^sb4 (/*)!  <  A* ,k, 

k  =  0,.. 

;K 

£d84  +  (1  -  eD)  I*  j34,*A f  <  10-  50/20. 


Here  e,  a,  Ed,  and  an  are  constants,  and  <S,  5i,  /i,  {Ui±},  {Pi,k },  <54,  {/34ir},  and  { U\^ }  are  auxiliary 
variables.  Although  this  is  a  much  more  complicated  specification  than  one  is  likely  to  encounter 
in  practice,  it  translates  to  only  about  35  lines  of  Matlab  code  to  solve  using  the  Opt  toolbox  1 15 1 . 
The  resulting  magnitude  responses  of  the  filter  and  the  overall  error  are  shown  in  Fig.  [6j  The  same 
characteristics  seen  in  the  previous  example  can  be  seen  here  in  the  multiple  stopbands. 
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6  Conclusions 


In  this  paper  we  demonstrated  the  ability  of  SOCP  to  constrain  more  interesting  FIR  filter  error 
norms  than  the  usual  L„,  L2,  and  L\.  In  particular,  the  vector  £-norm  was  extended  and  shown  to 
be  related  to  a  direct  norm  combination,  and  it  was  shown  that  these  combining  techniques  in  fact 
generate  three  different  norm/dual  norm  pairs  that  can  be  constrained  with  SOCR  The  examples 
provide  a  qualitative  comparison  of  the  resulting  filter  responses  to  true  Lp  designs.  The  real  strength 
of  SOCP  is  not  its  ability  to  solve  these  particular  unconstrained  optimizations,  although  it  can  do 
so  efficiently.  Rather,  it  lies  in  the  tremendous  flexibility  it  provides,  allowing  an  arbitrary  number 
of  constraints  of  the  sort  presented  here  while  at  the  same  time  enforcing  a  uniform  structure  that 
allows  for  efficient  solution. 
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A  The  e-Norm 


Definition:  For  a  function  E  E  L2[ 0, 1]  and  0  <  £  <  1,  define  the  £-norm  of  E,  denoted  |£||e,  as  the 
unique  solution  V*(E)  of 


h(v,E)±\\[\E\-(l-e)v]  ||2-£v  =  0. 


(13) 


Proof.  We  must  show  that  V*(E)  exists,  is  unique  and  possesses  the  properties  of  a  norm,  namely 


1.  ||£||e>0 

2.  pile  =  0  ^  E  =  0 

3.  |jy£||e  =  |y|||£||e 


4.  ||£  +  £| 


£  ^ 


l|£||e+l|£| 


(Positivity) 
(Positive  definiteness) 
(Homogeneity) 
(Triangle  Inequality) 


To  show  existence  and  uniqueness,  first  note  that  h(v,E )  is  a  continuous,  monotonically  decreasing 
function  of  v.  For  any  v  >  ||£,||00/(1  —  e),  we  see  that  h(v,E)  =  — £V  <  0,  and  since  li(0,E)  = 
||£||2  >  0  as  well,  there  must  exist  a  unique  solution  ||£||e  =  v*(£).  The  positivity  of  v*(£)  is 
guaranteed  by  the  positivity  of  the  L2  norm.  Positive  definiteness  (in  the  sense  of  Lp)  follows  directly 


from  (13 1  and  the  positive  definiteness  of  the  L2  norm.  Homogeneity  follows  from  the  relation 
h(\a\v ,  aE)  =  |a|/i(v,£),  which  implies  that  h(\a\v* (E) , aE )  =  0  and  v*(aE)  =  | « | v* (£") -  To 
show  the  triangle  inequality  we  use  the  triangle  inequality  for  the  L2  norm  and  the  fact  that  [E  + 
F]+  <  [Zi]+  +  [F]+  (in  a  pointwise  sense): 


h(v*(E)  +  v*{F),E  +  F)  +  e(v*(E)  +  v*(F)) 

=  UHe  +  E\-(1-£)(v*(E)  +  v*(F))}J2 

<  ||  [\E\  -  (1  -e)v*(F)]  +  +  [|F|  -(1  -  e)v*(F)]  +  ||2 

<  II  [1^1  -  (l  -£)V*(F)]  +  ||2+  ||  [\F\ -  (1  -£)v*(F)]  +  ||2 
=  h{v*(E),E)  +h{v*(F),F)  +  £{V*(E)  +  v*{F)) 

=  e{v*(E)  +  v*{F)). 


Thus,  h(v*(E)  +  V*(F),E  +  F)  <  0,  and  from  the  monotonicity  of  h(v,E+F )  in  v  we  have  V*(E  + 


F)  <  v*(E)  +  v*(F)  as  desired. 

n 

Lemma  2.  For  any  function  E  the  pair  of  functions 

Ee  =  e^E  [  £  —  (1  — £)  £  e]  + 

(14) 

£1_e  =  E  —  Ee 

(15) 

define  the  unique  decomposition 

E  =  Ee  +  El~e 

(16) 

called  the  ^decomposition  such  that 

|£e  |2  =  £  |£  |e 

(17) 

£1_e  oo  =  (1  —  e)  |£  |e- 

(18) 
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Proof.  The  support  of  Ee  is  restricted  to  the  set  /*  =  /*(£)  =  {/  :  \E(f)\  >  (1  —  £)||£j|e}.  By  con¬ 
struction  we  have  <[T6|),  ([17]),  and  (|T8j),  and  thus  the  ^decomposition  exists.  When  E  =  0  uniqueness 
is  clear,  so  let  E  0  and  choose  a  function  V  fE1~e  such  that  ||  V||oo  <  (1  —  £)||Lj|£.  Uniqueness 
then  follows  by  showing  that  for  U  =  E  —  V  we  have  ||  U  lb  >  eplle,  violating  ([TT]).  Using  the 
inner-product  notation  ||f/||,  =  ( U,U )  we  have 

\\U\\l=  \\E-V\\l=  \\Ee+El~e -V\\l 

=  ||£'e||5  +  2^{(£'e,£'1'e-U)}  +  ||£'1^e-U||^ 

>  e2\\E\\l  +  2qK{(Ee,El~e -V)} 

since  Hi?1'6  —  V\\l  >  0  results  from  positive  definiteness.  Now  consider  the  remaining  inner-product 
term 

29 X{(Ee,El~E-V)}=  f  m{Ee(f)(El-e(f)-V(f)y}dt 
Jtei * 

=  /  2(|E(/)|  —  (1  —  £)||E||e)  ((l  -  e)\\E\\e  ~yi{v* (f)ejZE^})  dt . 

Jt€l* 

The  first  factor  in  the  integrand  is  just  2\Ee(f)  |  and  thus  is  positive  on  I*  (and  zero  elsewhere).  The 
second  factor  is  nonnegative  on  I*  from  the  restriction  on  V.  Since  the  integrand  is  everywhere 
nonnegative  the  integral  is  also,  thus  ||U||;  >  £2||£||e  and  the  decomposition  is  unique.  □ 

Lemma  3.  The  unit  ball  of  the  £-norm  is  a  convex  Minkowski  sum  of  the  unit  balls  of  the  L2  and  Loo 
norms: 

{L:||L||e<l}  =  £B(||-||2)©(l-£)B(||.||oo) 

=  {£t/  +  (l-e)V  :  ||U||2<  1,  ||V||oo<  1}.  *  ’ 

Proof  By  Lemmata  suitable  eU  =  Ee  and  (1  —  e)V  =  £1-e  will  always  exist  given  ||£j|e  <  1. 
It  remains  to  show  that  for  any  U  and  V  such  that  ||t/||2  <  1  and  ||Vj|oo  <  1,  we  have  \\ell  +  (1  — 
e)U||e  <  1.  Apply  the  £-decomposition  to  get  E  =  eU  +  (1  —  e)V  =  E£  +  El~e,  then  using  an 
argument  similar  to  the  proof  of  Lemma  [2]  we  have 

£2  >  \\eU\\l=  ||£e  +  £1"e-(l-£)V||^ 

=  ||£'e||2  +  Hi?1-6  —  (1  —  £)U||2  +  29l{(£'e,£1~e  —  (1  —  fi)V)} 

>£2\\E\\l 

which  completes  the  proof.  □ 


Lemma  4.  The  dual  norm  of  the  e-norm  is  given  by 

ll^ll?  =  e||^ll2  +  (l-e)||F||i.  (20) 


Proof  The  dual  space  X*  of  a  complex  Banach  space  X  is  the  space  of  all  bounded  complex  linear 
functionals  on  X.  The  dual  space  is  also  a  Banach  space,  with  norm  [26 1 


ii/iid  =  sup  \m\. 

!i£ii<i 


(21) 


The  space  of  all  complex-valued  square-integrable  functions  on  [0, 1]  forms  a  Banach  space  with 
either  the  L2  or  £-norms.  We  use  the  definition  of  the  £-norm  unit  ball  to  write  the  £-norm  dual  as 


ll/ll?  =  sup  \f(eU  +  (l-e)V) 

\Mi<l 

IIU!~<i 
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Since  /  is  linear  and  both  the  Li  and  L„  norms  depend  only  on  the  magnitude  of  their  argument, 
suitable  U  and  V  functions  can  always  be  found  such  that 


|  f{eU  +  (1  -  e)V)  |  =  e\f(U)\  +  (1  -  e)|  f(V) \ 


yielding 


=  £  sup  \f(U)\ H-(1  —  e)  sup  |/(V)|. 

||t/||2<l  ||V||-<1 


(22) 


The  e-dual  norm  is  thus  the  convex  combination  of  the  dual  norms  of  L2  and  L„.  By  the  Riesz 
Representation  theorem,  all  bounded  linear  functionals  on  the  space  Lp[0, 1]  can  be  represented 
as  the  inner  product  f(E)  =  (. E,F ),  where  E  €  Lp[ 0, 1]  and  F  G  Lq[ 0, 1]  for  q  =  p/(p  —  1).  The 
functional  /  is  thus  fully  represented  by  the  Lq[ 0, 1]  function  F.  Holder’s  inequality  further  tells  us 
that  |(£,F)|  <  ||£||; 


\q,  so  that  the  dual  norm  of  Lp  is  Lq 


Rewriting  ( 22 1  in  terms  of  F  yields 


re  =  e  SUP  \(U,F)\  +  (l-e)  sup  |(V,F)| 

||C/||2<1  ||v||-<t 


=  £ 


D 


+  (l-e)ll^l 


and  applying  the  known  result  for  Lp  completes  the  proof. 
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